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Abstract 

The joint degree matrix of a graph gives the number of edges between vertices of 
degree i and degree j for every pair (i, j). One can perform restricted swap opera- 
tions to transform a graph into another with the same joint degree matrix. We prove 
that the space of all realizations of a given joint degree matrix over a fixed vertex 
set is connected via these restricted swap operations. This was claimed before, but 
there is an error in the previous proof, which we illustrate by example. We also 
give a simplified proof of the necessary and sufficient conditions for a matrix to 
be a joint degree matrix. Finally, we address some of the issues concerning the 
mixing time of the corresponding MCMC method to sample uniformly from these 
realizations. 

Keywords: degree sequence, joint degree matrix, Havel-Hakimi algorithm, 
restricted swap, Erdos-Gallai theorem. 
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1. Introduction 

In recent years there has been a large (and growing) interest in real-life social and 
biological networks. One important distinction between these two network types 
lies in their overall structure: the first type typically have a few very high degree 
vertices and many low degree vertices with high assortativity (where a vertex is 
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likely to be adjacent to vertices of similar degree), while the second kind is gen- 
erally disassortative (in which low degree vertices tend to attach to those of high 
degree). It is well known, the degree sequence alone cannot capture these differ- 
ences. There are several approaches to address this problem. See the paper of 



Stanton and Pinar for a detailed description of the current state-of-the-art. 



In this paper, we address the. joint degree distribution (or JDD) model. This model 
is more restrictive than the degree distribution, but it provides a way to enhance 
results based on degree distribution. In essence, the degree distribution of a graph 
can be considered as the probability that a vertex selected uniformly at random will 
be of degree k. Analogously, the joint degree distribution describes the probability 
that a randomly selected edge of the graph connects vertices of degree k and 

Amanatidis, Green and Mihail ^ and Stanton and Pinar |T7] introduced the joint 
degree matrix (or JDM for short) model which is a version of JDD. In essence, the 
JDD gives (for each i and j) the probability that an edge of the graph connects a 
vertex of degree i to a vertex of degree j, while JDM tells us the exact number 
of edges between vertices of degrees i and j. We will give precise definitions in 
Section [2] 

In a still unpublished paper |[l]], an Erdos-Gallai type theorem was presented for 
joint degree matrices. The lecture fv^ sketched its original proof. Stanton and 
Pinar ll4] gave a new, constructive proof for this theorem. In Section[5j we present 
a simpler proof which gives a more general construction algorithm. 



Also in 111411 . Stanton and Pinar proposed a restricted version of the classical swap 
operation (in their words: rewiring) to transform one realization of a JDM into 
another one. They describe this operation in terms of a generalized configuration 
model (for the original model see [2]), in which a swap is essentially a manip- 
ulation of perfect matchings in a bipartite graph. Indeed, if one also considers 
realizations that are multigraphs (i.e., graphs allowing loops and multiple edges), 
their generalized configuration model describes all possible realizations. Using a 
theorem of Ryser ([12]) on this generalized configuration model, Stanton and Pinar 
proved that the space of all multigraph realizations is connected. They address the 
connectivity of the space of all (simple) graph realizations of a JDM (those without 
multiple edges or loops), and claim to prove that restricted swap operations make 
the space of these realizations connected. We show in Section |3] that their proof is 
flawed, and present a correct proof of this result in Section 5] 



Stanton and Pinar also concluded 111411 that the corresponding MCMC algorithms 
that sample multigraph realizations and simple realizations of a JDM are both fast 
mixing. They claimed to give a proof for the first statement, and supported the 
second statement with experimental results. We address both of these claims in 
Section [6] 

Finally, in Section |7] we discuss some open questions. 
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2. Definitions 



For the remainder of the paper, unless otherwise noted, all graphs (and by exten- 
sion all realizations of a JDM) are simple graphs without isolated vertices, and 
the vertices are labeled. Let G = {V,E) he. an n- vertex graph with degree se- 
quence d(G) = {d{vi), . . . , d{vn))- We denote the maximum degree by A, and 
for 1 < i < A, the set of all vertices of degree i is Vi. The degree spectrum sg{v) 
is a vector with A components, where SG{v)i gives the number of vertices of de- 
gree i adjacent to v in the graph G. While in graphical realizations of a degree 
sequence d the degree of any particular vertex v is prescribed, its degree spectrum 
may vary. 

Definition 1. T/je joint degree matrix J^{G) = [Jij] of the graph G is a IS. x IS. 

matrix where Jij = \{xy G E[G) : x € Vi,y € Vj}\. If, for a k x k matrix M 
there exists a graph G such that J{G) = M, then M is called a graphical JDM. 

Remark 2. The degree sequence of the graph is determined by its JDM: 

\Vi\ = -^(^u+Y,ji}^. □ (1) 

Let G = {V, E) be a graph and a, b, c, d be distinct vertices where ac, bd ^ E 
while 6c, ad ^ E. If G is bipartite, we also require that a, 6 are in the same class 
of the bipartition. Then G' = {V,E') with 

E' = {E\ {ac, bd}) U {be, ad} (2) 

is another realization of the same degree sequence (and if G is bipartite then G' 
remains bipartite with the same bipartition). The operation in ^ is called a swap, 
and we denote it by ac, bd =^ be, ad. Swaps are used in the Havel-Hakimi algo- 
rithm ([8] and |7]). Petersen [11] was the first to prove that any realization of a 
degree sequence can be transformed into any other realization using only swaps. 



The corresponding result for bipartite graphs was proved by Ryser 11211 . 



An arbitrarily chosen swap operation on G may alter the JDM, so we introduce the 
restricted swap operation (or for brevity RSO), which preserves the JDM. 

Definition 3. A swap operation is a RSO if it is a swap operation of the form 
ac, bd be, ad, with the additional restriction that there is an i such that a,b (zVi. 

It is clear that RSOs indeed keep the JDM unchanged. Even more, an RSO changes 
only the degree spectrum of vertices a and b, a fact that we use repeatedly. When 
we refer to swaps on graphs and bipartite graphs that are not necessarily RSOs, we 
use the terms ordinary swaps and bipartite swaps. 
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3. The space of all graphical realizations — the challenges 



Stanton and Pinar 111411 propose an inductive proof to show that the restricted swap 
operations make the space of all realizations of a JDM connected. They take two 
realizations, G and H, of the same JDM, choose a vertex v, and using RSOs, they 
transform G and H into G' and H' with the property that the neighborhoods of v 
in G' and H' are the same set of vertices. They state that after removing v from G' 
and H' the JDM of the resulting graphs still agree, i.e. J{G' — v) = J{H' — v). 
Unfortunately, as the following example show, this is not the case, not even if we 
require in addition that the vertices in the neighborhood of V have the same degree 
spectra in G and H. 

Let G be a six-cycle with vertices labeled cyclically by integers {1, . . . , 6} Let H 
be the disjoint union of two three-cycles labeled cyclically by {1, 2, 3} and {4, 5, 6} 
respectively. G and H are 2-regular graphs on 6 vertices, both have the same JDM, 
J = [g g], and the degree spectrum of any vertex v is is sg{v) = sh{v) = (0, 2). 
If we consider vertex 2, we note that it's neighbor set is {1, 3} in each graph. On the 
other hand, the truncated realizations given by deleting vertex 2 from the graphs 
each have a different JDM. The truncated JDM for G is [22]' while for H the 
truncated JDM is 



■101 
-0 sJ- 







Figure 1: An example of two realizations of a JDM, where vertex 2 has the same 
neighbor set in both realizations, but whose truncated realizations do not have the 
same JDM. 



We also note that this is not an isolated example. Many pairs of graphs can be 
found that demonstrate the same problem. 
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4. The space of all realizations is connected under RSOs 



While Stanton and Pinar's proof is flawed, the statement of their theorem is still 
true, as we show here. That is, we show that any realization of a JDM can be trans- 
formed via restricted swap operations into any other realization. First we introduce 
some definitions and notation. 

Let J7 be a graphical JDM. We fix the vertex set V and its partition Fi U . . . U Va 
appropriately. A realization G is a graph on vertex set V where the set of vertices 
of degree z is V^. 

For each j, set Aj{j) := ^^p, and for i / j, Aj{i) := Simply put, for 

any realization G of J and for all pairs i,j the quantity Aj{i) gives the average of 
SG{v)i over all vertices v eVj. 

The set of degree j vertices Vj is balanced in G, if for each Vi the edges connecting 
Vj to Vi are as uniformly distributed on Vj as possible. In other words, for all 
V G Vj, and for all i, we have that SG{v)i G {L^i(^)J, A realization G 

is balanced if Vi is balanced in G for all i. 

We will show now that any reaUzation of a given JDM can be transformed into 
a balanced one via restricted swap operations. To this end, for a realization G, a 
vertex v, and index i, we define 

CG{v,i) := [\Aa(^^){i) -SG{v)i\j. 

Clearly, CG{v,i) > 0, and CG{v,i) = for a f G precisely when SG{v)i G 
{ [Aj , \Aj (i)] }. Our algorithm will be governed by the function 



When CgU) = 0, i.e. when cg{v, i) = for all v G Vj, then Vj is balanced. 

Lemma 4. IfCcij) ¥^ ^^'^ there are vertices u,v £ Vj and an RSO vw, uz =^ 
vz,uw transforming G into G' such that Ccij) < CgU) and for all i ^ j 



Proof. Choose u,v G Vj such that SG{u)i is minimal and SG{v)i is maximal 
amongst all vertices in Vj. Then we have SG{u)i < [Aj{i)\ < \Aj{i)] < SG{v)i 
with at least two strict inequalities.This implies that SG{u)i < lAj{i)\ < SG{v)i 
or SGiu)i < \Aj{i)] < SG'(f)i holds. Assume SG(it)i < L^j(^)J < SG(w)i (the 
other case is handled similarly). As u has fewer neighbors in Vi then v, there exists 
aw GVi such that vw G E{G) but uw ^ E{G). 

Since d{v) = d{u) = j and SG{v)i > SG{u)i, there exists n k ^ i such that 
SG(^f)fc > ^G{v)k- Consequently there exists z ^Vk such that uz G E[G) while 
vz ^ E{G). Thus vw, uz ^ vz, uw is actually an RSO. It is easy to see that 

CG{v,i) + CG{u,i) - 2 < CG'{v,i) + CG'{u,i) < CGiv,i) + CG{u,i) - 1 



k 




(3) 



veVj i=i 



CG'{i) = CG{i). 
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while 



CG{v,k) +CG{u,k) - 2 < CG'{v,k) + CG'{u,k) < CG{v,k) +CG{u,k). 

This implies Caii) < CgU). Cg'(^) = C'g(^) for ^ / j follows from the fact 
that this RSO can change only the degree spectrum of u and v. □ 

This lemma easily implies 

Corollary 5. Let G be a realization of a graphical JDM. There exists a series of 
RSOs transforming G into a balanced realization G'. 

Proof. If G is balanced we are done. Otherwise let {ji, . . . ,js} be the set of 
indices j for which CgU) / 0. We define a sequence G = Go,Gi, . . . ,Gs such 
that for each 1 < i < s there is a sequence of RSOs transforming Gj„i to Gi, 
CciUi) = and for i ^ ji we have GGi{^) = Cd^ii^)- Successive applications 
of Lemma|4]with j = ji give that an appropriate sequence of RSOs exists for each 
i. It follows that Gs is balanced. □ 

It remains to show that any two balanced realizations are connected via a sequence 
of RSOs. To this end, we introduce the following definitions. We call Vi mixed with 
respect to Vj if Aj{i) is not an integer. (Note that it is possible for Vj to be mixed 
with respect to itself.) When Vi is mixed with respect to Vj, we call a vertex v ^ Vj 
low for Vi if SG{v)i = lAj{i)\, and call it high for Vi if SG{v)i = lAj{i)\ + 1. 
The auxiliary bipartite graph A{G, j) = {U, P; E), is given hyU = {uy : v ^Vj}, 
P = {pi : Vi is mixed with respect to Vj}, and E = {u^Pi : v is high for V}- 
Now we are ready to show 

Lemma 6. If there is a bipartite swap operation transforming A{G, j) = (U, P; E) 
into A' = {U, P; E'), then there is an RSO transforming G into G' such that 
A{G',j) = A', andsG{v) = sg' (v) for each vertex v ^ Vj. 

Proof. Let u^Pi^u^pk =^ u^Pk^u^Pi be a bipartite swap transforming A{G,j) 
into A'. Then v,w ^ Vj, and in the graph G the vertex v is high for Vi, w is high 
for Vfc, u is low for V^ and w is low for Vi. Therefore there exists x & Vi and 
y eVk such that vx £ E{G), wx E{G), vy ^ E{G) and wy G E{G). It's 
easy to see that vx., wy vy, wx is an RSO transforming G into a G' that has the 
desired properties. □ 

This easily implies 

Theorem 1. If G and H are two balanced realizations of the same JDM, then 
there is a series of RSOs transforming G into G', such that sg'{v) = sh{v) for 
each V ^V. 

Proof. We will define a sequence of graphs Go = G,Gi, . . . , Ga such that for 
1 < z < A we have a sequence of RSOs that transforms to Gi, with the 



6 



properties that sg-(i') = sh{v) for each v ^ Vi and s^. (f) = SGi_^{v) for each 
V ^ Vi. With is already defined, consider the bipartite graphs A(Gi- \ , i) 
and A{H, i). They have the same degree sequences. Thus Ryser's Theorem {{I'l]) 
gives a sequence of bipartite swaps transforming one into the other. Repeated 
applications of Lemma [6] implies the existence of RSOs transforming into 
a Gi with the required properties. (In fact, one can use Theorem 3.5 from i5j to 
determine the minimum sequence length necessary for the task.) The statement 
then follows by choosing G' = Ga- □ 

We are ready now to prove the main result. 

Theorem 8. The space of all realizations of any given JDM is connected via RSOs. 

Proof. Let G and H be two realizations of the same JDM. Corollary |5]will trans- 
form our realizations via RSOs into balanced realizations G' and H'. Apply- 
ing Theorem |7] transforms G' via RSOs into a balanced realization G" such that 
sqii [v) = sh' (v) for each vertex v. For i ^ j let Gij and Hij be the bipartite 
graphs spanned by vertex sets Vi and Vj in G" and H' respectively, and let Ga and 
Ha be the corresponding graphs spanned by V-i. Notice that ordinary and bipartite 
swap operations in Gij (when i = j and i ^ j) are in fact RSOs in G", and the 
degree sequences of Gij and Hij are the same. A straightforward application of the 
corresponding Havel-Hakimi algorithm and ^ or lU]) and Ryser's theorem 



( il2l1 ) gives us a sequence of RSOs transforming G" to H. 

Since the inverse of any RSO is also an RSO, the proof is complete. □ 



5. Characterization of Graphical JDMs 

The following characterization for a square matrix M with integer entries to be a 
graphical JDM was proved by Amanatidis, Green and Mihail in the still unpub- 
lished paper In the lecture of Schmitt (|13]) one can find a sketch of that proof. 



Later Stanton and Pinar gave another constructive proof. Here we provide a more 
transparent and direct approach to the construction. As it provides simple neces- 
sary and sufficient conditions for a matrix to be realized as a graphical JDM, we 
call the result an Erdds-Gallai type theorem (see 

Theorem 9 (Erdos-Gallai type theorem for JDM). Ak x k matrix J is a graphical 
JDM if and only if the following hold. 

(i) for alii : rij := i [ J'ij + ^ Jij ) is an integer; 

(ii) for alii: Ju < {^^; 

(iii) for all i ^ j : Jij < riirij. 
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Proof. The necessity of the properties is trivial, so it remains to show that they are 
sufficient. 

Assume that J satisfies the required properties. We need to construct a graph G 
with J{G) = J. 

We fix a partition V into k vertex sets Wi, . . . , Wk with \ Wi\ = n^. For any graph 
G = {V, E) we will use the notation Gij to denote the graph on vertex set Wi U Wj 
with edge set Eij = {xy £ E : x G Wi,y G Wj}. Clearly, Gij = Gji and for 
i ^ j the graph Gij is bipartite. Moreover, for {i,j} ^ the graphs Gij and 

Gi'j' are edge-disjoint. 

We set Q be the set of all graphs G' where for each 1 < i < j < k the graph 
G[j has J'ij edges. The conditions on J' ensure that G is nonempty. However, if 
G' £ Q, then Wi may not be the set of vertices of degree i m G' , thus G' is not 
necessarily a realization of J. On the other hand li G' £ Q has the property that 
for all i the set of degree i vertices is Wi, then J{G') = J. 

For a G' G a let 

k 

^(G') :=E E \dG'{v)-i\, 
i=i veWi 

and let G be a graph minimizing ip in Q. Clearly, ip{G) > 0, and if ip{G) = 0, 
then Wi is the set of vertices of degree i in G, and consequently J^{G) = J . 

Assume to the contrary that ^(G) > 0. This means that we have an i such that 
Wi is not the set of vertices of degree i in G. Since the sum of the degrees of the 
vertices in Wi is i\Wi\ in G, there are x,y £ Wi with dcix) < i and dciy) > i- 
Thus there is a j (not necessarily different from i) and a z G Wj s.t. yz G E{Gij) 
and xz ^ E{Gij). Let G* = {V,E*) where E* = {E{G) \ {yz}) U {xz}. It is 
easy to see that G* € G with i>{G*) < i>{G), a contradiction. □ 

We note that the proof easily translates to an algorithm to create a realization of J. 
In fact, as noted above, every realization of J can be generated in this manner. 

6. Some observations on the corresponding Markov chains 

The paper I'lT] presents a configuration model for generating realizations of a JDM, 
and discusses Markov chains that act on this configuration model. We give a short 
description of the model and the Markov chains, and discuss some issues concern- 
ing the mixing times of these Markov chains. 

The configuration model and the Markov chains 

A graphical JDM J determines \Vk\ for every k in every realization by ([T}. For 
each k, and each vertex w G 14, create a cloud of k mini- vertices corresponding 
to V. For each edge e arising from Jij, create two vertices labeled by e. One of 
class i, and one of class j. We connect all mini- vertices arising from Vk to all edge 
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vertices of class k. The result is a complete bipartite graph irfc|Vfc|,A;|Vfe| for each 
k. The collection of these graphs is called the generalized configuration model. A 
realization of J' can be found as follows. Take a perfect matching on each bipartite 
graph (this is called a configuration). Define a (possibly multigraph) realization by 
having v adjacent to it; if a vertex in the cloud of v and a vertex in the cloud of w 
are adjacent to the two vertices labeled by the same edge e. 

It is easy to see that this will generate a (perhaps multigraphical) realization of J', 
the resulting graph may have loops and multiple edges. [il41 proposes the following 
Markov chain. 

Given a starting configuration, with probability 1/2, do nothing. Otherwise, choose 
a random edge viei of the configuration, and another random edge ^262 in the same 
bipartite component as the first edge. Perform the swap viei, 1^262 ^'162, t'2ei- 

It is clear that this process will output another configuration, and hence a multi- 
graphical realization of J^. This Markov chain, which calls chain A, gen- 
erates multigraphs. A secondary Markov chain, which they refer to as chain B, 
begins with a configuration that corresponds to a simple realization, follows the 
same procedure, but rejects the swap if the corresponding realization is not a sim- 
ple graph. 

Sampling from chain A 

Stanton and Pinar claim that chain A allows for uniform sampling of the configu- 
ration model, and hence of multigraphs. They correctly concluded that this chain 
is rapidly mixing on the space of configurations, and hence can be used for finding 
a random configuration nearly uniformly. We have two points to make here. 

First, uniform sampling of the configuration model can be achieved in a much 
more straightforward manner than a Markov chain. One simply needs to provide 
random permutations to describe the matchings for each complete bipartite graph. 
Generating uniformly random permutations is both simpler and much faster than 
implementing the proposed Markov chain. 

Second, and more importantly, uniform sampling from the space of configurations 
does not yield uniform sampling from the space of all multigraphs. To see this, 
consider the JDM J' = [93]. It is easy to verify that this is the JDM for precisely 
5 multigraphs on 3 labeled vertices. The first is a C3, the second is three vertices 
with one loop each, and the other 3 graphs each consist of one loop and a double 
edge. In the configuration model, there is only one bipartite graph, consisting of 6 
mini-vertices and 6 edge-vertices. Hence there are 6! = 720 different configura- 
tions possible. A computation reveals that 384 correspond to C3, 48 correspond to 
the graph with three loops, and 96 correspond to each of the loop -1- double-edge 
graphs. In this case, a uniform distribution on configurations yields a distribution 
that favors the C3 over the three-loop graph by a factor of 8, certainly far from 
uniform sampling. 
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Figure 2: The three non-isomorphic multigraphs realizing the JDM J = 3]. The 
first two have unique labelings, while the third has three distinct labelings. 

Sampling from chain B 

Stanton and Pinar noted (and we agree) that bounding the mixing time of the 
Markov chain B seems to be a very difficult problem without some new ideas 
or techniques. They conducted a series of experiments, running chain B multiple 
times on 1 1 sample graphs of varying sizes, and measured the autocorrelation time 
of the chain, a measurement that they say can be substituted for the mixing time. 

Indeed, for a particular sampling from a fixed JDM, autocorrelation may be an 
excellent metric for determining how many steps to take between samples, and a 
way to check that samples are close to uniformly chosen. Also, the autocorrelation 
experiments do provide some evidence for rapid mixing. We take issue with their 
claim that this evidence shows that the Markov chain is fast-mixing in practice. 

Our view is the following: autocorrelation is an excellent tool to show that a 
Markov chain is not fast mixing. However, it is not powerful enough to show 
the opposite. It can show that one particular run of the Markov chain is good, but 
it cannot predict that all outcomes will be good as well. Even if an experiment is 
repeated many times, it may give some confidence that the chain is fast-mixing for 
one the particular JDM, but this may not relate to how it may act on another. 

7. Further Directions 

Because the space of realizations of a joint degree matrix is connected, one could 
use the Markov chain B above to pick a random realization. Proving the rapid 
mixing of this chain, though seemingly an intractable problem at the present, would 
be a clear step forward. 

Another option would be to generate a random realization. In the authors de- 
velop a constrained version of the Havel-Hakimi algorithm for realizing a degree 
sequence. This constrained version is able to directly generate every possible re- 
alization. Furthermore, in [3], the authors determine a way to provide a weight 
corresponding to each degree sequence realization, which can be used to make the 
sampling uniform. It would be of both theoretical and practical interest to do the 
same for joint degree matrices. 

Finally, it is interesting to note that for degree sequences, there are at least two 
distinct descriptions of when a sequence is graphical: One by Erdos-Gallai 
and the other by Havel [8J. The characterization by Havel lends itself to a simple 
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algorithmic implementation for building realizations, much moreso than that of 
Erdos and Gallai. Perhaps there is also a second description of the matrices that 
can be realized as the joint degree matrix of a graph, one which can be used directly 
construct many different graphical realizations. 
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